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METHOD AKD APPARATUS FOR DATA liOGGZfilG 



This invention relates to a method and apparatus for data logging. 
BACRGRODND 

Data logging in this specification is the process of collecting data 
from mobile devices performed in order to obtain business information 
relating to how the mobile devices operate. For exanple, position, 
location and speed of a vehicle over time is useful log data for use in 
insurance liability calculations for that vehicle. In another example, 
signal strength of a mobile communication system over both time and 
position is useful log data to enaJole a telecommunication company to plan 
its trans-litter locations. Such data is collected by a mobile embedded 
system using positional information and sicnal strength information from 
sources including the network itself (e.g. GSM) and global positioning 
satellites (GPS) . Log data is stored in the mobile embedded system for 
later transmission to the central system. Transmission is by mobile phone 
network or other wireless technology. 

Transmission of the data log may be performed on demand, when the 
device is ready it requests control of the transmission channel. Such a 
system is described in OS Patent Publication 62 632 68 which discloses a 
mobile automotive telemetry system for installation on-board a vehicle. It 
includes a diagnostic structure for monitoring operational functions of a 
vehicle and a server which communicates with the diagnostic structure to 
riBceive operational information. The operational information is uploaded 
to the server when the information is ready. 

Another download on demand system. International Patent Publication 
02/03350, discloses a method and system for monitoring cellular 
communication. The method continuously extracts traffic load and speed on 
roads within the coverage area of a cellular network from a mobile device 
in a vehicle. The data is extracted! directly from the higher level of ' 
communication in a cellular network so there is no scheduled or negotiated 
download of data from the mobile device. 

One problem with downloading log" data on demand is that it can lead 
to a conflict situation when several, devices are requesting control of a . 
single download channel and attempting to download at the same time. Only 
one request per channel will be successful at any one time and the other 
requests fail. The failed requests use download resouxce so that more 
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resource is used for non-ordered requests than for ordered requests. One 
way to order the downloads is to schedule them to come in at a certain 
tines . 

US Patent publication 0028313 discloses a distributed telemetry 
method and system affected by co-ordinating the taking of .readings of a 
parameter by mobile phone users, the parameter readings being sent to a 
service system together with location information on the users. It is the 
task of a query scheduler to. amongst other things, organise when the 
reading of interest are to be taken. The reading is sent to the service 
system immediately or triggered by. .for exaitple. a scheduled time. 

The problem with scheduled remote data logging is that simultaneous 
and multiple device upload of data can create overload on a server that 
coliects such log data v;hen the bandwidth is different from that 
predicted. 

STOfflS&iiy OF THE IHVBMTIOSS 

According to a first aspect of the present invention there is 
provided a dati logging method for transferring log data to a server over 
a wireless network from a plurality of remote devices, said server for 
receiving data from the plurality of said devices; said method. comprising 
the following steps: 

scheduling a transfer period for transferring log data from a device 
to the server taking into account the wireless network signal strength of 
the device for the scheduled transfer period whereby the scheduled 
transfer period does not overlap a time when the estimated wireless 
network strength is too low to transfer the log data; and 

transferring data determined by its respective transfer period in 
the schedule. 

The scheduling step above advantageously comprises, the following 

steps : 

selecting a device from the plurality of devices; 

providing a transfer size for data to be transferred from the 
selected device; 
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calculating, for the selected device, a transfer period including a 
start time and an end time to transfer the log data to the server, the 
calculation using the selected device's transfer size and using transfer 
periods of other devices if toown; 

estimating, for the selected device, wireless network signal 
strength data for the calculated transfer period; 

performing, for the selected device, the calculating and estimating 
steps again if the transfer period overlaps a period of time where the 
estimated- wireless network strength is; below a predetermined threshold; 
and 

storing the transfer period in a schedule. 
The method advantageously further comprising: 

acquiring the actual transfer size for a device before 'transferring 
the data; 

re- calculating the transfer period for the first device; and 

re- calculating transfer periods of other devices if the 
re-calculated transfer period of the first device affects the transfer 
periods of the other dievices. 

Suitably, when calculating the transfer period, the server transfer 
capacity is taken into account. 

More suitably, an estimate is made using historical server transfer 
capacity data from a similar time period. 

Preferably, for a particular device, more than one transfer period 
is calculated so that the data may be downloaded. Such a device is one 
existing in variable signal strength conditions. 

More preferably the device alerts the. server to the actual transfer 
size when or before transfer takes place. If the actual transfer size is 
significantly different to the predicted transfer size then the server 
recalculates the schedule.* 



wo 2004/091149 



4 



PCT/GB2004/001448 



Advantageo\isly, the server stores wireless network signal strength 
for each client with respect to time. 

More advantageously, the server makes an estimate of future wireless 
network signal strength for a particular client based on the signal 
strength at a previous time, for instance, the same time of day a week 
before. If the signal strength is acceptable for all or most of the 
scheduled transfer then the server can assume a low chance of 
interruption. Conversely if there is an interruption in this previous 
transfer, the server can assume a high chance of interruption. 

Suitably, the server stores wireless position data for each client 
with respect to time and makes an estimate. .of future wireless network 

signal screngrh by estimating future position based on the present 
posi-ion, direction of rravel, and tpeed of travel. 

More suitably the method further comprising: 

acquiring the actual wireless network signal strength before • 
transferring log data; and 

rescheduling the transfer period if actual wireless network strength 
is below a predetermined threshold. 

Preferably, the method is performed on devised in a defined 
priority. 

More preferably a device's priority is defined by its wireless 
network signal strength. 

Advantageously a device's priority is defined by the quantity of 
data to transfer'. 

More advantageously, there is provided a reserve channel for service 
information. If a device finds that it has not been serviced but now has a 
need to transfer data. The device can proactiyely contact the server to 
request a higher priority of servicing. This request and data transfer 
needs to use an alternative channel of communication into the server and 
ensures that other lower priority tasks do not block its request. 

Suitably, some devices do not have a scheduled download but download 
on demand. This allows for the benefits of an on-demand download as well 
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as that from adaptive scheduling. Some devices may be deactivated, hence 
to not need to be included into the scheduling and planning system while 
in this state. They are treated as non- scheduled devices and data log 
download is on-demand and when available. 

DBSCRZPTZON OF THE SRAWX2I6S 

In order to promote a fuller understanding of this and other aspects 
of the present invention, an embodiment of the invention will now be 
described, by means of example only, with reference to the accompanying 
drawings in which: 

Figure 1 is a schematic diagram of the present embodiment of the 
invention.; 

Figure 2 is a schematic diagram of a profile data structure stored 
by the present embodiment of the invention; 

Figure 3 is a schematic diagram of a plan data structure stored by 
the present embodiment of the invention; and 

Figure 4 is a method according to a first embodiment of the present 
invention 

DSSCRXPTZOH OF THE £3mODZHE33TS 

Referring to Figure 1, a data logging system comprises: a server 300 
connected over a mobile networJc to a plurality of remote client devices' 
100A...N, The first device is lOOA, second device is lOOB and so on up to 
lOON where N is of order a million devices. Each device lOOA. . .N 
comprises: profile data 102; a device profiler 104; a data log 106; a 
device controller 108; and a data exchange 110. The server 300 conprises : 
profile data 301; a device profiler 302; a scheduler 304; a plan 306; an 
updater component 3 08; data exchange 310; a bandwidth forecast component 
311; and an upload component 312. Log data is stored in a datastore 400. 

Device profiler 302 maintains each device profile 102 collected from 
the client devices. 

A device profile 102 includes characteristics relating to the device 
but not the download data itself. Referring to Figure 2, device profile 
102 comprises two profiles for each device in the preferred embodiment: 
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firstly a connectivity profile 103A; and secondly a download profile 
103B. 

The connectively profile 103A includes GSM radio reception power 
over time and comprises a data structure having a date and time field and 
GSM signal field. In a further, embodiment the geographical position of the 
device will be included in the connectivity profile where it is derived 
from global positioning system (GPS) data or trigonmetric data from the 
GSM receivers. The status of a device is recorded over a week as this is 
mostly likely to show a pattern. However, in other embodiments, a longer 
period may be used instead of or as well as . A day of data is normally 
regarded as the minimum, although theoretically it could be smaller, and 
three weeks of data gives' better averages.. More than four weeks of data 
puts pressure on the storage resource of the device profiler 302. 

The cniEJiriry of data previously collected allows for at least an 
estimate to be made of the next Quantity of data dov.Txloaded . The device 
profiler 3 02 provides information to the device scheduler 304 to enable it 
to establish an estimate for connection time. It also provides information 
relating to GSM power levels so that unsuitable connection times can be 
estimated. 

The download profile 103B, stores, for each device, a record of each 
download of data and comprises the time of download and the quantity of 
data collected in the download. 

The scheduler 304 builds the plan 306 by allocating time periods to 
each specific device based initially on the amount of data that each 
device is expected to transfer. Device scheduler 304 receives the actual 
network usage from the data exchange 310 and' bandwidth forecast — 
information from con^onent 311. If the scheduler 304 sees that current 
network usage exceeds or is much less than that used to build the plan 306 
then the scheduler 304 updates the plan 3 06. The device scheduler 304 
works to substantially 80% full capacity so that overruns can be catered 
for and rescheduling work does not continuously replan. 

The plan 306 (see Figure 3) is a data structure that stores a 
download schedule for each device. Each download for a device is a record 
in the database having four fields: 1) transfer period (start time and end 
time); 2) the device identification; and 3) the transfer size. 
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The updater contponent 308 keeps a device updated as to its scheduled 
time by passing messages with the current schedule details and also when 
relevant changes are made to the plan 306, It keeps track of a device that 
is off-line and informs the off-line device as soon as it becomes on-line 
through the data exchange 310. 

The update coitponent 308 negotiates with the scheduler 304 in case 
the device has run out of memory or has not downloaded for an excessive 
period of time. The scheduler 304 identifies change in the plan 306 and 
informs the updater coitiponent 3 08 and updates the plan 306 with 
confirmation from the devices 100A.._.N. 

The bandwidth forecast component 311 ^monitors current download 
activity from actual data transfers going through the data exchange 310, 
rro~ tr^is inf cnri=:tion the r resent dovjnload bariavv'idth casi be monitored and 
stored for future planning refererice. This data is then used to provide a 
forecast of network capacity for the scheduler 3 04, which then in turn may 
choose to throttle back the data transfer by moving devices, or move 
devices up to take advantage of available bandwidth. In another embodiment 
the bandwidth component acquires forecast information from a network 
supplier. 

The uploader 312 determines when to update client devices with new 
software. It takes as input plan 3 06 to provide an indication of other 
traffic that may make use of the data communications lines 210,206. The 
plan 306 will have an inrpact on deciding when to upload software to the 
client devices as each download will reduce the * effective' communications 
bandwidth for data upload. 

The client device lOOA will now be describedr- Client devices-lOOB. .N 
have the same components and configuration but different identification. 
Each device lOOA. . .N coi^prises: profile data 102; a device profiler 104; . a 
data log 106; a device controller 108; and a data exchange 110. 

The profile data 102, maintained by the device profile component 
104, maintains a profile of the device's cpnnectivity and data 
volumetrics. It is the profile data 102 that is sent to the server 300 to 
be used in planning and prioritization by the scheduler 304. 

The data log 106 contains the log data for transfer to the server 
300, it also may contain any specific data used by the device controller 
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108. The key objective is to transfer log data 106 from the client to the 
datastore 400 via the server 300. 

Device controller 108 is responsible for ensuring co-ordination of 
the log data 106 and controls the download of data to the server 300 and 
the communication of data volumes. It is the device controller 108 that 
initiates the data connection and bulk transfer based on the scheduled 
time received from the server 300. The device controller 108 receives the 
schedule information from plan 306 via the update coit5>onent 308. Before 
the downloading of the log data the device controller 108 establishes 
communication with the scheduler 304 through update component 308 and the ■ 
data exchange mechanism 310/110 to check for final adjustments. Ideally 
each client lOOA. . .N would be controlled by the same version of device 
controller 108 but it may be that some devices have been updated by 

2. ="^2. c^^'e-E s.""e 'osLtio an older" version. Software upcates can 
be transferred between the ser\^£r 300 and the clients lOOA. . .N along, the 
same communication lines as the data is transferred. 

Method 400 of the embodiment is described with respect to Figure 4. 
The scheduler 304 selects, step 402, a first client device from the 
available devices in the profile data 301. Each device has previously 
contacted the server and registered itself as available in the profile 
data 301. Each device sends information relating to its expected future 
download size and this is stored in a download profile 103B. The device 
profiler 302 creates new profile data structures for each new registered 
device and stores the contact details of the device in the device profile. 
Any future download size is stored in. the related download profile data 
structure- 

The scheduler 304 acquires, step 404, the transfer size fo-r^ log data 
from the download profiles. 

The scheduler 304 calculates, step 406, the future transfer period 
of device based on the availability of the download bandwidth of the 
server 300 and the transfer size of the log data estimated in st^ 404. 
The calculation excludes certain periods t^at have been eliminated at step 
410 due to a weak signal strength. 

The scheduler 304 estimates, step 408, the signal strength by 
looking up the connectivity profile of the device. The simplest embodiment 
uses the signal .strength of a week previous but another embodiment ^ 
averages the signal strength from the last two or three weeks. 
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The scheduler 304 coirpares, step 410, the estimated signal with a 
threshold. If the estimated signal strength is below the tlireshold then 
the signal strength will be too low for reliable transmission of data and 
the method branches back to step 406 and a new transfer period will be . 
calculated. 

The scheduler 304 stores, step 412, the transfer period in the plan 
306. At this point the updater 308 sends the transfer period to the device 
in question. 

The scheduler 304 then performs, step 413, for each device lOOA. .N 
the steps 402 to 412 so that the plan 306 has a scheduled time and a 
scheduled download size for each device lOOA. .N. 

The plan. 30c selects, step 414, a device having an imminent transfer 
period-. 

The scheduler 304 acquires, step 415, an. actual transfer size by 
comm-oni eating with the device controller 108 through data exchange 
110/310. The device controller queries the log data 106 and returns the 
value . . 

The scheduler 304 recalculates, step 416, the transfer period at 
this later stage. 

The scheduler 304 acquires, step 418, the actual signal strength 
before transmission. 

The scheduler 3 04 checks, step 420 if the acquired signal strength 
is below a threshold. A typical threshold would be "20% of maximum power 
but this value would depend on the working conditions of the 
implementation. If the acquired signal strength is below 20% then the 
present transfer is aborted. A new transfer period is needed and the 
method goes back to step 406. If the acquired signal strength is 20% or 
above then the method proceeds to step 422. 

Once the signal strength is confirmed then the log data is 
transferred, step 422, through the data exchange mechanism 310/110. In the 
preferred embodiment the device controller 108 initiates the communication 
and log data transfer at the scheduled time. In another embodiment the 
scheduler 304 initiates the download communication when it checks the 
signal strength- 
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The scheduler 304 then performs, step 423, for each entry in the 
plan 306 the steps 414 to 422 so that each device transfers its log data 
when the signal strength is acceptable. 

Although the embodiments have been described in tenas of a single 
server it is possible to scale the solution up to two or more servers. 



